Mohammed et al. BMC Health Services Research 2012, 12:430 
http://www.biomedcentral.eom/1 472-6963/1 2/430 



Health Services Research 



RESEARCH ARTICLE Open Access 



Factors which influence the length of an 
out-of-hours telephone consultation in primary 
care: a retrospective database study 

Mohammed A Mohammed 1 *, Gill Clements 2 , Elaine Edwards 2 and Helen Lester 1 



Abstract 

Background: Given the increasing use of telephone consultation it is important to determine the factors which 
influence the length of a telephone consultation. 

Method: Analysis of 128717 telephone consultations during January to December 201 1 to a National Health Service 
(NHS) out-of-hours primary care service provider in Shropshire and Telford and Powys, England, involving 102 
General Practitioners (GPs) and 36 Nurse Practitioners (NPs). Telephone consultation conclude with one of three 
outcomes - advice only, the patient is invited to a face-to-face consultation with a GP or NP at a nearby health 
centre (known as a base visit) or the patient is visited at home by a GP or NP (known as home visit). Call length 
was analysed by these outcomes. 

Results: The overall mean call length was 7.78 minutes (standard deviation (SD) 4.77). Calls for advice only were 
longest (mean 8.1 1 minutes, SD 5.17), followed by calls which concluded with a base visit (mean 7.36 minutes, SD 
4.08) or a home visit (mean 7.16 minutes, SD 4.53). Two primary factors influenced call length. Calls by GPs were 
shorter (mean 7.15 minutes, SD 4.41) than those by NPs (mean 8.74 minutes, SD 5.31) and calls designated as a 
mental health call were longer (mean 1 1.16 minutes, SD 4.75) than all other calls (mean 7.73 minutes, SD 7.7). 

Conclusions: Telephone consultation length in the out-of-hours setting is influenced primarily by whether the 
clinician is a GP or a NP and whether the call is designated as a mental health call or not. These findings suggest 
that appropriate attempts to reduce the length of the telephone consultations should focus on these two areas, 
although the longer consultation length associated with NPs is offset to some extent by their lower employment 
costs compared to GPs. Nonetheless the extent to which the length of a telephone consultation impacts on 
subsequent use of the health service and correlates with quality and safety remains unclear. 

Keywords: Telephone consultation, Duration, Efficiency, Nurse practitioner, General practitioner, Out-of-hours, 
After-hours, Emergency care, Primary care, Telephone, Triage 



Background 

Telephone consultations are an increasingly common 
[1-4], feature of modern healthcare, especially in the pri- 
mary care setting. Over the period 1995 to 2006, the 
proportion of all General Practitioner (GP) consultations 
conducted on the telephone trebled whilst the propor- 
tion recorded as home visits halved [5]. Telephone con- 
sultations appear to be acceptable to patients [6] and 
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also offer time, efficiency and cost-saving benefits but 
questions about safety, and cost still remain [7-9]. 
Nevertheless, perhaps driven primarily by the need to re- 
duce costs, there is an ongoing commitment in the NHS 
to improving access to primary care by extending open- 
ing hours and expanding the provision of telephone con- 
sultations in primary care [10]. A key driver of cost and 
hence as a candidate performance indicator [11,12], in 
the face-to-face consultation is the length of the consult- 
ation; but whilst studies internationally have provided 
insight into factors which influence the length of face- 
to-face consultations in primary care [13-17], much less 
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is known about what factors influence the length of tele- 
phone consultations in primary care. The aim of this 
study, using telephone consultations data collected from 
an out-of-hours primary care service provider (known as 
ShropDoc [18]) over a twelve month period, was to de- 
termine which factors influenced the duration of the 
telephone consultation. 

Methods 

Data source 

ShropDoc is a not-for-profit GP Cooperative Company 
that provides urgent medical services for patients when 
their primary care GP surgery is closed and whose needs 
cannot safely wait until the surgery is next open. Typic- 
ally the out-of-hours times are 1800h to 0800h Monday 
to Friday and all hours for weekends and bank holidays. 
Shropdoc provides services to 600,000 patients in Shrop- 
shire, Telford and Wrekin and Powys and handles ap- 
proximately 140,000 calls and over 50,000 face-face 
patient contacts per year [16]. Contact between patient 
and clinician commences with a telephone call. A call 
handler takes the patients details, identifies immediate 
life threatening conditions using a "trigger list" (diverts 
these to the 999 ambulance service) and then prioritises 
the call (i.e. urgent or routine). The patient is then called 
back by a GP or a Nurse Practitioner (NP) and this call 
is defined as the telephone consultation. This concludes 
with one of three outcomes - advice only, the patient is 
invited to a face-to-face consultation with a GP or NP at 
a nearby health centre (known as a base visit) or the pa- 
tient is visited at home by a GP or NP (known as a home 
visit). Neither GPs nor NPs use computer assisted algo- 
rithms/decision support systems in ShropDoc. Upon re- 
ceipt, the telephone calls go into a queue - the urgent 
calls are returned within 20 minutes and the routine 
with 60 minutes. The start of a consultation occurs 
when the clinician opens the patient record and makes 
the call and ends when the clinical record is closed by 
that clinician and so this includes time to read existing 
notes and write additional notes. We analysed all of 
ShropDocs out-of-hours telephone consultations in the 
twelve month period (January to December 2011). In 
general the majority of calls are handled on a first-in- 
first-out basis but this sequence can be overridden by 
the clinician, especially where there is an urgent clinical 
need. The work was undertaken as part of the regular 
audit and service evaluation undertaken by ShropDOC. 

Statistical analysis 

Call length is reported in minutes and summarised as 
means and standard deviation (SD) as well as medians 
and inter-quartile ranges (IQR), although for statistical 
modelling we used means. Our primary analysis involved 
Classification and Regression Trees (CART) which are a 



statistical data mining based technique for constructing 
trees by recursively splitting or partitioning patients into 
homogenous groups [19] and have been used to support 
medical decision making [20-22], although their use is 
still somewhat novel. Tree models can reflect human de- 
cision making and are intuitive to interpret because they 
have a simple visual presentation which starts by identi- 
fying the most important predictor variables, naturally 
incorporates interaction effects and identifies cut-offs for 
continuous covariates. As first developed, CART, could 
lead to quite large tree models, but recent work has 
incorporated p-value based tree modelling, known as 
conditional classification trees, which yield smaller tree 
models whilst simultaneously controlling for multiple 
testing and are available in the Party Package [23] in R 
[24]. 

Our purpose in using the conditional tree models is to 
uncover the factors which influence the length of the 
telephone consultation as opposed to predictive model- 
ling [20]. The factors that we considered were based on 
variables that were routinely collected in ShropDocs 
database, of which we selected the following: patient's 
age, patient's gender, date/time call started, date/time 
call ended, outcome of the call (advice, base visit or 
home visit) and whether the clinician was a GP or a NP. 
ShropDoc also classify their calls into broad clinical 
headings using their internally developed categories. The 
majority of calls were classified as "Other" (73.6%), but 
we did flag calls which were classified as, Respiratory 
n= 11795, Pharmacy/Medication n=6610, Minor Injury 
n=4807, Mental Health n=2666, Acute Retention and/or 
Catheter n=1806, Palliative Care n=2336, Deceased 
n=1023 and Dental calls n=281 in the tree models. We 
also included variables for identifying calls that were 
made on a Saturday or a Sunday because experience 
from ShropDoc indicated that these days may be differ- 
ent in terms of workload and healthcare service 
provision. 

We produced conditional trees for each outcome - 
advice, base visit and home visit. Each node in the tree 
shows the factor (with its statistical significance, which 
we predefined at p<0.01) and the end of the branches 
are rectangles which show the sample size (n) and the 
mean call duration (y) in minutes. Each node in the tree 
also has a node identification number for ease of 
reference. 

Results 

In the twelve month period (January to December 2011) 
there were 128717 telephone consultations involving 102 
doctors and 36 NPs. The mean age of patients was 42.15 
years (SD 30.25) of whom 57.5% were female (38634/ 
128717). The mean telephone consultation length was 
7.78 minutes (SD 4.77). Almost two-thirds of the calls 
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ended with advice only (617%, 79379/67245), about a 
quarter ended with a base visit (24.0%, 30763/128717) 
and 14.4% ended with a home visit (18575/128717). We 
produced conditional tree models for each call outcome 
(see Figures 1,2,3). Calls designated as a mental health 
call were longer (mean 11.16 minutes, SD 4.75) than all 
other calls (mean 7.73 minutes, SD 7.7). 



Advice only 

The mean call length for calls that ended with advice 
only was 8.11 minutes (SD 5.17). The tree model 
(Figure 1) showed that the primary predictor (node 1) 
of call length was whether the call involved a GP (mean 
7.52 minutes, SD 4.68) or a NP (mean 9.10 minutes, SD 
5.77), although GPs dealt with older patients (GP mean 
patient age 45.73 years, SD 29.68 vs NP mean patient 
age 35.40 years, SD 29.04). For NPs and GPs, three 
types of calls featured in the tree model (mental health, 
minor injuries and pharmacy related) whilst the patients 
age and calls designated as acute retention and/or cath- 
eter related featured only in the GPs half of the tree 
model. Calls designated as mental health calls were the 
longest durations for GPs (node 11: mean 11.19 min- 
utes, SD 7.68) and NPs (node 7: mean 12.53 minutes, 
SD 9.42), whereas calls designated as minor injuries 
were the shortest duration for GPs (nodes 21,24,31 and 
37) and NPs (node 10). Call length was also influenced 
by Saturday and/or Sunday - for example, for GPs and 
NPs, pharmacy related calls were significantly longer on 
a Saturday compared to other days of the week. The 
patient's gender did not feature in the tree model. 



Base visit 

The overall mean call length for calls that ended with a 
request for the patient to be booked into a base appoint- 
ment for a face-to-face consultation with a GP or a NP 
was 7.36 minutes (SD 4.08). The tree model (Figure 2) 
again showed that the primary predictor (node 1) of call 
length was whether the call was involved a GP (GP 
mean 6.40 minutes, SD 3.53) or a NP (mean 8.30 min- 
utes, SD 4.35) although GPs dealt with older patients 
(GP mean age 31.15 years ; NPs mean age 27.94 years). 
For GPs, mental health calls were the longest in length 
(node 22, node 15) although NPs took longer with men- 
tal health calls than GPs (GPs mean 10.46 minutes, 
n=174 ; NPs mean 11.74 minutes n=102) the mental 
health calls were absent from the tree model. For both 
GPs and NPs, minor injury calls were the shortest 
(nodes 6, 20 and 27), although NPs took longer than 
GPs. Interestingly, there were no apparent Saturday/ 
Sunday association in the tree model. Once again, the 
patient's gender did not feature in the tree model and 
perhaps unsurprisingly neither did pharmacy related 
calls, minor injury calls or calls involving the notification 
of a death. 

Home visit 

The overall mean call length for calls that ended with a 
home visit was 7.16 minutes (SD 4.53). The tree model 
(Figure 3) again showed that the primary (node 1) pre- 
dictor of call length was whether the call was made by a 
GP (mean 6.57 minutes, SD 4.07) or a NP (mean 8.16 
minutes, SD 5.07) although this time GPs and NPs dealt 
with patients of a similar age profile (GPs mean age 
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Figure 2 Tree model identifying factors associated with call duration for all calls that ended in a base visit. 



71.03 years; NPs mean age 71.72 years). Mental health 
calls were the longest in length with little difference be- 
tween GPs and NPs (GPs mean 10.24 minutes, NPs 
mean 10.59 minutes). Calls where the caller notified 
ShropDoc of a death were the shortest in duration, with 
GPs taking an average of 3.95 minutes (node 31) whilst 
NPs took an average of 4.93 minutes (node 12). Some 
influence of Saturday and/or Sunday was seen in the GP 
section of the tree model but not in the NP sections. In 
addition, the GP section of the tree identified respiratory 



disease as a factor (node 23) associated with shorter 
calls, whilst the NPs section of the tree identified acute 
retention and/or catheter related (node 8) as being asso- 
ciated with shorter duration. 

GPs and NPs 

Since the tree models consistently identified the clini- 
cians profession (GP or NP) as a key factor in determin- 
ing telephone consultation call lengths we undertook 
additional analyses comparing GPs and NPs (see Table 1), 




Figure 3 Tree model identifying factors associated with call duration for all calls that ended in a home visit. 
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Table 1 Some characteristics of telephone consultations 
by GPs and NPs 
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which showed some systematic differences. GPs were 
more likely to conclude a call with advice only (GPs 
64.93% vs NPs 56.91%), whilst NPs were less likely to 
conclude a call with a home visit (GPs 15.26% vs NPs 
13.22%) but more likely to conclude a call with a base 
visit (GPs 19.81% vs NPs 29.86%). 

Discussion 

Summary of main findings 

Using a large volume of telephone consultations over a 
one year period in the out-of-hours setting in primary 
care we were able to estimate that the mean call length 
was 7.78 minutes (SD 4.77). The fact that GPs and NPs 
have persistently different call lengths, even after con- 
trolling for some patient characteristics, and differing 
rates of advice and base visits suggests that there may be 
some systematic differences in the communication and 
decision making process of GPs and NPs. Mental health 



calls took the longest, for GPs and NPs, irrespective of 
the call outcome (advice, base visit and home visit). 
Whilst studies have reported longer face-to-face consul- 
tations for patients with mental health related issues in 
primary care [13,14,25] this is the first time that this has 
been reported in the telephone consultation context. We 
also found mental health calls with NPs were longer 
than those with GPs, although this difference was most 
pronounced for calls ending in advice and became less 
pronounced for base and home visits. 

Comparison with existing literature 

The mean call duration of 7.78 minutes is, perhaps un- 
surprisingly, shorter than the average consultation length 
seen in English general practice (9.4 minutes), but is not 
dissimilar to face-to-face consultations reported [7] for 
Germany (7.6 minutes SD 4.3) and Spain 7.8 minutes 
(SD 4.0). However, as Deveugele et al [7] noted, deter- 
mining the length of face-to-face consultation is not 
straightforward (e.g. because of different operational 
definitions for the start and end times adopted by differ- 
ent researchers). This applies equally to telephone con- 
sultations because in our study the times included 
reading/writing of notes on the computer system. Fur- 
thermore, the extent to which meaningful comparisons 
between countries can be made in respect of consult- 
ation length, be it face-to-face or telephone based con- 
sultations, is unclear because of differences in health 
systems and the role of the GPs [7-9]. Whilst telephone 
based out-of-hours service provision is seen in several 
countries, there are differences, with varying levels of 
clinical qualified staff (including lay people) in the front- 
line, working with/without protocols and with/without 
second level triage from experienced GPs, making it dif- 
ficult to meaningfully compare call durations inter- 
nationally. Even in the English NHS, there are several 
models of out-of-hours call centres. 

Strengths and limitations 

Our study provides a valid comparison between GPs and 
NPs in the out-of-hours setting but the findings are not 
generalisable to settings where decision support systems 
are routinely used or where NPs are not working along- 
side GPs. From an employment cost perspective, the 
longer telephone consultations lengths associated with 
NPs are offset, to some extent, by their lower employ- 
ment costs. This also needs to be balanced against pos- 
sibly reduced access for other patients and the lower 
advice rates and higher rates of base visits delivered by 
NPs. Nevertheless the extent to which the length of a 
telephone consultation impacts on subsequent use of the 
health service and correlate with quality and safety re- 
main unclear. 
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Our study did not set out to test any specific hypoth- 
eses although we have generated several for possible fu- 
ture testing. We did not assess the quality or safety of 
the telephone consultation, analyse the reason or ur- 
gency for the call, the appropriateness of the clinical out- 
comes, including patient satisfaction or analyse the 
variation within GPs and NPs. These issues merit further 
study. 

Implications for clinical practice 

Health systems need to continually find new ways to 
provide safe, cost effective care. Primarily because of 
cost savings and supported by evidence from RCTs 
that NPs are generally regarded as safe in telephone 
consultations (although some concern was noted in a 
Dutch study [26,27],), the deployment of NPs in roles 
more traditionally associated with doctors is increas- 
ing [28]. ShropDoc have set up their service so that 
patients may consult a GP or a NP, irrespective of 
the nature of the call. Indeed this novel model of ser- 
vice provision, where GPs and NPs work alongside 
each other, may offer other benefits in building team- 
work and shared expertise, despite longstanding dif- 
ferences of power, pay, status and gender between 
these two healthcare professionals [18]. 

Conclusions 

Telephone consultation length in the out-of-hours 
setting is influenced primarily by whether the clin- 
ician is a GP or a NP and whether the call is desig- 
nated as a mental health call or not. The result 
suggests that appropriate attempts to reduce the 
length of the telephone consultations should focus on 
these two areas, although the longer consultation 
length associated with NPs is offset to some extent by 
their lower employment costs compared to GPs. 
Nevertheless the extent to which the length of a tele- 
phone consultation impacts on subsequent use of the 
health service and correlates with quality and safety 
remains unclear. 
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